Documentation from trained medical students has a low rate of relative downcoding for emergency medicine encounters.

Background: Since 2018, the Centers for Medicare & Medicaid Services (CMS) guidelines have allowed teaching physicians to bill for evaluation and management services based on medical student documentation. Limited previous data suggest that medical student documentation suffers from a high rate of downcoding relative to faculty documentation. We sought to compare the coding outcomes of documentation performed by medical students, and not edited by faculty, with documentation edited and submitted by faculty. Methods: A total of 104 randomly selected notes from real patient encounters written by senior medical students were compared to the revised notes submitted by faculty. The note pairs were then split and reviewed by blinded professional coders and assigned level of service (LoS) codes 1-5 (corresponding to E&M CPT codes 99281-99285). Results: We found that the LoS agreement between student and faculty note versions was 63%, with 23% of all student notes receiving lower LoS compared to faculty notes (downcoded). This was found to be similar to baseline variability in professional coder LoS designations. Conclusions: Notes from medical students who have completed a focused documentation curriculum have less LoS downcoding than in previous reports.

Metrics of Resident Achievement for Defining Program Aims.

INTRODUCTION: Resident achievement data is a powerful but underutilized means of program evaluation, allowing programs to empirically measure whether they are meeting their program aims, facilitate refinement of curricula and improve resident recruitment efforts. The goal was to provide an overview of available metrics of resident achievement and how these metrics can be used to inform program aims. METHODS: A literature search was performed using PubMed and Google Scholar between May and November of 2020. Publications were eligible for inclusion if they discussed or assessed "excellence" or "success" during residency training. A narrative review structure was chosen due to the intention to provide an examination of the literature on available resident achievement metrics. RESULTS: 57 publications met inclusion criteria and were included in the review. Metrics of excellence were grouped into larger categories, including success defined by program factors, academics, national competencies, employer factors, and possible new metrics. CONCLUSIONS: Programs can best evaluate whether they are meeting their program aims by creating a list of important resident-level metrics based on their stated goals and values using one or more of the published definitions as a foundation. Each program must define which metrics align best with their individual program aims and mission.

Number of Patient Encounters in Emergency Medicine Residency Does Not Correlate with In-Training Exam Domain Scores.

INTRODUCTION: Emergency medicine (EM) residents take the American Board of Emergency Medicine (ABEM) In-Training Examination (ITE) every year. This examination is based on the ABEM Model of Clinical Practice (Model). The purpose of this study was to determine whether a relationship exists between the number of patient encounters a resident sees within a specific clinical domain and their ITE performance on questions that are related to that domain. METHODS: Chief complaint data for each patient encounter was taken from the electronic health record for EM residents graduating in three consecutive years between 2016-2021. We excluded patient encounters without an assigned resident or a listed chief complaint. Chief complaints were then categorized into one of 20 domains based on the 2016 Model. We calculated correlations between the total number of encounters seen by a resident for all clinical years and their ITE performance for the corresponding clinical domain from their third year of training. RESULTS: Available for analysis were a total of 232,625 patient encounters and 69 eligible residents who treated the patients. We found no statistically significant correlations following Bonferroni correction for multiple analyses. CONCLUSION: There was no correlation between the number of patient encounters a resident has within a clinical domain and their ITE performance on questions corresponding to that domain. This suggests the need for separate but parallel educational missions to achieve success in both the clinical environment and standardized testing.